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CROSS REFERENCE TO RELATED APPLICATIONS 



Not applicable. 
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STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
DEVELOPMENT 
Not applicable. 

10 BACKGROUND OF THE INVENTION 

This invention relates to modiem transmission over packet networks. In particular, the 
present invention relates to techniques for demodulating, relaying, and remodulating low speed 
(eg. V.22, V.22bis and V.21) modem transmissions over packet networks. 

15 When modem devices are connected through a packet network, they are not directly 

connected. The entire modem signal is packetized at the sending end, sent over the packet 
network and reassembled into a designated format at the receiving end before presentation to the 
receiving modem device. 
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For example, packetizing and transportation of modem calls over gateway platforms using 
G.71 1 (PCM) codec, requires digitizing the originating modem phone line at 64Kbps, packetizing 
and transporting the entire 64 kbps data stream to the other side, and then sending out the same 
64 kbps data stream to the remote modem. The advantage of this approach is that it works for 
5 any modem that can be received on a standard POTS phone line, and it is simple to implement. 

The disadvantage of this approach are: 

(1) it requires a large amount of network bandwidth to implement the call and a 
connection can be dropped because of packet loss. If G.71 1 packets are being sent every 10 

10 mSec, then the network bandwidth required to send each direction of the call is over 1 10 kbps 
(when the header sizes (RTP+UDP+IP+TCP+Ethemet) are included). 

(2) The connection over a packet network is not a constant connection and often 
experiences line delays, errors, jitter and/or packet loss which can result in modem errors. In 
particular, packet loss results in interruptions in the modem signal (intermittent carrier loss) at the 

15 receiving modem. The interruptions result in degraded data throughput due to modem retrains 
and increased modem connection failures. 

(3) Due to the clock differences at the two end points, standard G.71 1 playout techniques 
will periodically exhibit a modem signal interruption due to playout overruns and/or underruns. 
Again these interruptions in the modem signal lead to periodic modem retrains impacting data 

2 0 throughput rates. 
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In summary, when G.71 1 coding with packetization is used for data modem transmissions, 
the two modems are essentially communicating to each other using a potentially inadequate 
medium for their transmission. This approach is particularly vulnerable to network packet loss. 

SUMMARY OF THE INVENTION 

The modem relay of the present invention allows for the capability to demodulate, relay, 
and remodulate modem transmissions over packet networks. 

The modem relay provides a local interface to the modem on both ends of the call, 
demodulates the full duplex data stream, packetizes the bits for transport over an IP network, and 
remodulates the data stream at the remote end. The modem relay provides bandwidth savings, 
and improved performance (data throughput and connection reliability) in a packet loss 
environment. 

The modem relay mitigates the problems associated with using G. 7 11 to send modem 
traflBc. In modem relay, the physical layer or link layer of the modem signal is terminated locally 
for both ends of the call. Only the demodulated data stream is sent over the network. This leads 
to dramatic bandwidth savings. For a V.34 modem, in an exemplary embodiment, the 64 kbps 
phone line is demodulated into a maximum of 33,600 bps data stream. That data stream is 
packetized and transported with a network bandwidth of less than 20 kbps (for 30mSec packets). 



Since the physical layer is terminated locally, network packet loss will not result in any 
interruption in the modem signal at the receiving modem. Therefore this approach will eliminate 
connection failures due to the network packet loss. Instead a packet loss will result in an error in 
the information data stream. 



Bandwidth savings are also realized using Modem Relay in that data is carried over the IP 
network only as the modem transmits data. When the modem is not transmitting data, no packets 
are sent on the IP network. In contrast, continuous 64 kbps packetization takes place when using 
G.71 1 to carry modem traffic. Depending on the network transport, the modem data is sent over 
10 the packet network using a guaranteed delivery mechanism (link layer termination) or sent using a 
non-guaranteed delivery mechanism (physical layer termination). In the case of a non-guaranteed 
delivery mechanism, data redundancy techniques can be used to combat packet loss and improve 
data throughput. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 
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Figure 1 is a diagram illustrating the components of a modem relay configuration. 



Figure 2 is a diagram illustrating a point-of-sale implementation of the present invention. 
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Figure 3 is a flow decision diagram illustrating the decision sequence for determining the 



modulation and connection speed. 
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Figure 4 is a logic diagram illustrating an exemplary logic structure for modem 
identification and modem relay activation. 

Figure 5 is a logic diagram illustrating an alternative logic structure for modem 
identification and modem relay activation. 

Figure 6 is an exemplary implementation of a DSP voice channel configuration. 

Figure 7 is an exemplary modem relay DSP configuration. 

Figure 8 is functional block diagram of an exemplary modem relay unit. 

DETAILED DESCRIPTION OF THE INVENTION 

The modem relay for V.22bis modems and below occurs at the physical layer. The 
modem's physical layer is demodulated into a bitstream and that bitstream is relayed end-to-end 
across the network. Any higher layer protocols (error correction, compensation) that may be 
present are passed end-to-end across the network. 

A typical modem relay system configuration is illustrated in Figure 1 . For lower speed 
modems, a typical end-user application is in point-of-sale terminals used to implement credit card 
validation. Figure 2 illustrates a point-of-sale implementation using modem relay. 



The steps in setting up a modem relay connection are: 

1) A first user, initiates a modem call using a dial-up modem, such as modem 2 attached to 
a personal computer 1 or in a point-of-sale terminal 20, at the first end of the connection. 

2) Modem 2, enters an ofF-hook state, dials and waits for the far end modem 14 to answer. 

3) The first gateway 3 detects the line seizure, opens a DSP voice channel and collects 
DTMF digits. 

4) The first gateway 3 translates the dial number and attempts to perform a call setup to 
the far end gateway 9 which is located at a remote point in the network. 

5) Gateway 9 detects the incoming call setup from gateway 3 over the packet network 8. 
The gateway 9 accepts the incoming call and opens a DSP voice channel to handle the incoming 
call Next, gateway 9 seizes the outgoing line. 

6) For modem relay, the outgoing line connects to modem 14 at the far end which may be 
connected to a personal computer 15 or may be a modem in a modem pool 24. Modem 14 goes 
oflF-hook and plays a modem answer sequence (eg. V.25 ANS tone). 

7) Gateway 3 detects the modems answer sequence (as described below) and switches the 
DSP over from a voice channel to a modem relay channel. Then gateway 9 sends the switch over 
message to gateway 3 in the form of a modem relay message packet. Gateway 9 also continues to 
negotiate with far end modem 14 to establish a data connection to PC 15. 

8) Gateway 3 switches its channel to modem relay and begins to negotiate channel setup 
with modem 2. 

9) During the negotiations, control messages are exchanged between gateway 3 and 
gateway 9 to coordinate the compression format used on both sides of the link and to establish the 



gateway to gateway LAPM link. At the end of the negotiation, both modems have connected 
with their respective local gateway at the best possible connection rate using V.42 LAPM and the 
same type of compression. Further, the modems on both sides have transitioned into data mode 
and are ready to begin sending or receiving data. 
5 10) Modem 2 and modem 14 now begin sending data back and forth across the packet 

network 8. Each gateway unit demodulates the modem transmissions, packetizes the data and 
sends it to the far side. The gateway on the far side remodulates the modem data and sends it to 
the far end modem. Throughout the connection, flow control is performed on each segment of 
CI the link to regulate the error free transmission of data. 

" I 10 1 1) The connection continues until one of the modems hangs up. At that point, the call is 

terminated on both sides and the channels then return to idle. 

■.A s 

■33 ^ 

:: 

Throughout a modem relay call, the state machines in the modem relay unit periodically 

\^ : 

1 3 1 

! ■: ? 

Ill send line status updates to make sure that both modems remained in sync with each other. 

The operation of modem relay is driven by events that occur when gateway 9 seizes its 
outgoing line and places a call to modem 14. Initially gateway 9 does not know that the call is a 
modem call, and begins by using a voice processing configuration in the DSP 13. When modem 
14 answers, it begins play out of a V.25 answered tone (ANS), as illustrated in Figure 3. 
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When modem relay is enabled, gateway 9 switches to the low speed modem relay DSP 
code after it detects the V.25 answered tone, and proceeds to monitor the incoming sequence 
from modem 14. Gateway 9 attempts to establish a V.22bis, V.22 or V.21 data connection. 
Depending on the type of modem on the line, the decision sequence illustrated in Figure 3 is 
executed to determine the modulation and speed for the connection. If a fax signal is detected, 
the modem relay code sends a message to the microprocessor code to perform a switch to fax 
relay. 

At each stage of the negotiation process, gateway 9 will be sending signaling messages 
across the network to gateway 3. Because there is no guaranteed method of flow control 
between lower speed modems, both sides of the connection must be trained to operate at the same 
modulation and rate. Therefore, signaling messages are used to determine if the capabilities of the 
two modems can support an optimal connection. If there is a capability overlap, the best 
commonly supported data rate will be selected at both sides. If there is no modulation and rate 
common to modem 2 and modem 14, then the call will be a connected independently at both 
sides. These "uneven" connections work, but not as efficiently as connections that support the 
same data rate at both ends. 

For V.32 modems and above, V.42 error correction is frequently used to provide link 
layer connectivity and error correction between the two modem and points. For V.22bis modems 
and below, V,42 error correction may or may not be present in the connection. 
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For V.22bis modems and below, if V.42 is present, it is handled transparently by passing 
error correction end-to-end over the network Therefore, both modems have to be synchronized 
at the start of the call to use the same modulation and data rate. Then, V.42 and other high layer 
protocols are simply ignored by the modem relay software. This approach will work provided 
that network end-to-end delays do not exceed one second. If the network delay exceeds one 
second, then the modems will be able to connect to each other but not be able to establish LAPM 
protocols across the link, which will increase the error rate and prevent data compression (V.42 
bis) for the modem session. 

There is currently no network protocol standard defining the call control or data 
transmission protocol for modem relay over packet networks. Therefore, a proprietary approach 
is utilized by the present invention to implement modem relay. However, the present invention 
can be implemented with a standard protocol without departing from the scope of the inventive 
concepts taught herein. The protocol is similar to the proprietary fax relay protocol disclosed in 
co-pending application 09/03 1,047. The modem relay protocol used accommodates 
encapsulation using the RTP format for transmission across the network. 

The modem relay protocol has the following features: 

Redundant Signaling Messages - There are two types of signaling messages: call 
control and modem control signaling. Once a modem call is established, the only call 
control message that is expected is a termination event. Modem control messages 
including events like forced retraining or carrier loss events. All of the signaling messages 



between the two gateway units 3 and 9, are sent periodically throughout the call by the 
modem relay unit. They are sent more rapidly during call setup and negotiation. A 
signaling message is contained in a single modem relay packet, which conveys the current 
state of the call. If the network drops any one signaling packet, another packet will be 
sent soon so that the call can still proceed normally. If there is a network outage during a 
modem call that interrupt the packet flow between modem relay units, each side of the 
connection will perform a clear down on its part of the call. 

Redundant data. Instead of sending the same packet several times, data 
redundancy is achieved by appending data from previous packets in the payload section of 
the current data packet. Then, the receiving gateway uses the packet sequence number to 
determine if there has been a packet loss. If no packet loss occurred, it uses the most 
recent data field in the packet. If the receiving gateway detects that packet loss has 
occurred, the data fields for lost packets are retrieved by reading fiarther down in the ^ 
current packet. Data redundancy effectively increases the network bandwidth, though the 
actual data from the modem is a small part of the overall packet size. For instance, in a 
2400bps modem with a lOmSec VIF size, the data size is 3 bytes and the header size is 48 
bytes per network packet. Adding in additional 3 bite data fields will not increase the 
overall packet size by a significant amount based on a percentage of the total size. The 
amount of redundant data contained in each packet is configurable. 
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Retraining is also accommodated by the present invention. In the event that one of the 
modems in the connection experiences a loss of equalization on the line, it can initiate a retrain 
signal. When a gateway receives the retrain signal, it executes the retraining sequence locally and 
sends the retrain signal across the network to the other gateway. Both sides of the connection are 
negotiated to support the best case common rate. 

Since the retraining and rate signaling events may not be supported by one of the modems 
in the connection, a potential system problem occurs when one side initiates a retrain. The 
significance of this problem will depend upon the modem capabilities. If both sides of the call 
cannot be read trained to the compatible rate, the call will be terminated and cleared. 

Call discrimination is accomplished through processing in the DSP. When a call is 
connected, the gateway must determine what type of call processing is required to successfully 
implement the call: voice, fax relay, modem relay, or PCM. Individual channels can be pre- 
configured for a certain type of processing, but in general the gateway does not know in advance 
what type of devices are going to be involved in the call. The earlier it can distinguish the type of 
traffic involved in a call, the faster it can switch over to use the right set of processing resources. 

Figures 4 and 5 illustrate alternative embodiments for the decision tree for determining the 
processing sequence for new calls. Initially, the originator places a call were the packet network. 
Upon detecting a call, the answering gateway sees the line and goes off hook. The answering 
gateway then determines if a V.25 answer tone (ANS) with phase reversal, used by V.32, V.22 



and V.21 modems, is present. When detected on the answering side, the gateway will switch to 
modem relay processing. 

If phased reversal is not present, the ANS is the basic V. 25 answer tone used by fax 
machines and V. 32, V. 22 and V. 21 modems. When detected on the answering side, the 
gateway will switch to modem relay processing is the channel is preconfigured for modem relay 
and will not switch if the channel is potentially expecting fax transmissions. In the event that no 
ANS tone is detected, the answering gateway will then check for V. 21 flags which is the queue 
to switch to fax relay processing. The if no events are detected, the gateway will to continue to 
process the call using voice codec. 

Most of the functionality required to implement modem relay is located in the DSP 
software of the gateway. Figure 6 illustrates a standard DSP voice channel configuration. When 
added, the modem relay unit, MRU, is added as a processing lock in the DSP software. Figure 7. 
Modem relay channels are added to the DSP system integration unit SIU. Modem data pumps are 
added to the DSP software. Modem relay encapsulation and protocol fiinctions are added to the 
MRU DSP software and MRU configuration and statistics commands are added to the SIU. 

The microprocessor of the gateway also needs to be modified to accommodate the modem 
relay processing requirements. The microprocessor must respond to messages fi^om the DSP that 
instruct the microprocessor to switch over from a voice channel to a modem relay channel in the 
DSP. The microprocessor must be able to respond to modem relay packets arriving from the 
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network by switching a voice channel to a modem relay channel in the DSP. The microprocessor 
must allow the operator to configure and query statistics on a modem relay channels and must 
extend the NMM operator command set to accommodate commands needed to implement 
modem relay. 

5 

The SIU handles control and status messages fi^om the microprocessor that reference to 
channel as it does for other types of DSP channels. Messages fi'om the microprocessor that are 
unexpected or not supported in modem relay mode will be returned with an error code. 

4) 10 Within the MRU, Figure 8, is the functional software for modem relay. The structure of 

the MRU includes a modem driver connected to the PCM interface, a modem relay protocol unit 
' and a modem network driver which connects to the network interface. The modem driver 

J provides the interface between the PCM interrupt routine and the modem data pump, which 

js: s 

111 performs the physical modulation and the modulation functions of the current modem. The 

ill 

15 modem relay protocol module tracks the modems control and state machine functions and 

provides both data and messaging queues and overflow buffers. It also formats the modem data 
and signals into the proprietary modem relay protocol. The modem network driver performs the 
RTP encapsulation functions to implement the modem relay protocol containing signaling 
messages and data. It also provides a jitter offer to compensate for network delays. 
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The establishment and negotiation of a connection using V. 22 bis modems is illustrated in 
the connection ladder diagram of Figure 9. The modems will establish and negotiate a connection 
between the two gateways using the gateway communication messages to coordinate the modem 
sessions. As illustrated, the call is initially established as a voice call until the tones to establish 
modem relay are detected. The modem relay units exchanged a handshake, and appropriate 
connection is negotiated the modem relay units contact and then establish relay states for 
beginning the modem data over IP communication. 

Because many varying and different embodiments may be made within the scope of the 
inventive concept herein taught, and because many modifications may be made in the 
embodiments herein detailed in accordance with the descriptive requirements of the law, it is to be 
understood that the details herein are to be interpreted as illustrative and not in a limiting sense. 
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